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This  paper  summarizes  a  study  that  was  conducted  to  address  user 
irfo'Tnatior.  reauirements  for  the  Force  Level  Control  System.  It  was  the 
*irst  in  a  series  being  conducted  at  the  U.S.  Army  Tactical  Command  and 
lor.trol  System  Experimentation  Site  (AES).  User  information  requirements  were 
:etermined  via  monitoring  and  classification  of  communications  during  a 
:ommand  and  control  exercise,  as  well  as  through  subsequent  exerc’se 
a-ticipant  input.  Separate  measures  of  observed  communication  freouency, 

3ted  importance,  and  rated  perishability  were  obtained  for  a  set  of 
rformation  elements  that  comprised  a  rnmprehensive  taxonomy  of  tactical 
•oramand  and  control  communications  content.  Analys'  ^  were  then  conoucted  to 
xciore  the  relationships  between  freouency,  imoortance,  ana  perishabiMty  as 
sll  as  oevelop  a  comprehensive  index  of  criticality.  The  resulting 
;  imprehensive  index  of  criticality  is  intended  to  be  used  by  systems 
?'■  elopers  ir  selecting  the  information  tc  be  convevec  and  processed  by  the 
Leve'  Control  Syttem. 


Introduction 

The  U.S.  Army  is  currently  developing  the  automated  Force  Level  Control 
T,ystem  (FLCS).  The  FICS  is  a  software  system  being  developed  to  assist  in 
the  collection  and  integration  of  tactical  information.  Tlie  ultimate  function 
of  tlie  nCS  is  to  facilitate  the  commander's  job  of  commanding  and  controlling 
!iis  Forces  by  providing  a  comprehensive  summary  of  the  battlefield  situation. 
Thus,  a  central  concern  during  the  development  of  this  system  is  the 
identification  of  user  information  requirements.  The  present  paper  reports 
the  first  in  a  series  of  empirical  evaluations  of  FLCS  user  information 
requirements.  The  U.S.  Army  Tactical  Command  and  Control  System 
Experimentation  Site  (AES)  has  published  a  more  thorough  technical  report  of 
this  research  (McCallum,  Bittner,  &  Badalamente,  October,  1989). 


Mr 'hod 

Information  requirements  were  identified  by  integrating  findings  from 
two  converging  data  collection  efforts.  The  first  data  collection  effort 
involved  remote  monitoring  the  command  and  control  communications  of  four 
principals  and  their  immediate  assistants  in  a  brigade  tactical  operations 
center  during  a  72  hour  exercise.  Monitoring  was  accomplished  through  video 
cameras  and  microphones  placed  in  the  brigade  tactical  operations  center  and 
the  interception  of  all  brigade  radio  and  telephone  communications.  Dependent 
measures  recorded  by  subject  matter  experts  (SMEs)  for  each  monitored 
communication  included:  (i)  classification  of  the  communication  as  an 
information  request  or  transmittal,  (ii)  identification  of  the  communication 
originator  and  recipient,  (iii)  the  tactical  operation  during  which  the 
communication  occurred  and  (iv)  the  content  of  the  communication. 

Communication  content  was  determined  via  reference  to  a  comprehensive  taxonomy 
of  command  and  control  communications. 

The  second  data  collection  effort  involved  the  collection  of  subjective 
ratings  from  the  four  brigade  principals  and  their  immediate  assistants. 
Brigade  personnel  completed  standardized  forms  to  provide  ratio-based 
import  arc  and  perishability  ratings  for  a  subset  of  the  information  elements 
comprising  the  taxonomy.  For  the  purposes  of  ratings,  importance  was  defined 
as  "the  relative  importance  of  the  information  for  battlefield  decision 
making."  Perishability  was  defined  as  "the  length  of  time  before  a  specific 
information  element  may  be  expected  to  be  significantly  changed  with  respect 
to  an  operation  (e.g.,  its  "half-life"  during  a  Defense).  Ratings  were 
obtained  for  each  of  three  operations  comprising  the  exercise  (defense, 
attack,  and  river  crossing). 


Results 

A  total  of  2,536  voice  communications  involving  one  or  more  of  the 
brigade  principals  were  o!  served  and  classified  by  SMEs  during  the  operatic. 
Repeated  Measures  Analysis  of  Variance  were  conducted,  using  frequency 
looari thus ,  to  determine  the  effects  of  three  factors  on  information  element 
frectuet.cy:  information  element,  operation  (defense,  attack,  and  river 


crossing),  and  information  request  versus  transmittal.  Information  element 
frequencies  were  found  to  vary  substantially  (F(61,122)  =  34.84,  £<.00005). 
Additionally,  the  frequency  of  information  element  communication  was  found  to 
interactively  vary  w’‘'  tactical  operations  (F(122,122)  »  2.45,  £<.005). 

Among  the  66  information  elements  in  the  taxonomy,  observed  frequencies 
ranged  from  a  high  of  513  for  communications  dealing  with  Enemy  Unit  Locations 
to  a  low  of  0  for  communications  dealing  with  six  other  information  elements. 
The  frequency  distribution  across  information  elements  can  be  generally 
characterized  as  approximately  declining  with  the  reciprocal  of  element  rank. 
Figure  1  depicts  the  frequency  distribution  for  the  13  most-frequently 
communicated  information  elements  which  cumulatively  account  for  over  80 
percent  of  all  communications. 


Figure  1.  Relative  Percentage  of  Information  Elements  Accounting  for  80% 
of  All  Voice  Communications 
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Importance  ratings  were  based  on  a  scale  from  0  to  100.  Average 
importance  ratings  ranged  from  a  high  of  100  for  Division  Mission  to  a  low  of 
35.9  for  Electronic  Warfare  Schedule.  Perishability  ratings  were  provided  in 
hours.  Average  perishability  ratings  ranged  from  a  low  of  3  hours  for  both 
Target  Location  and  Location  of  Enemy  Barriers  and  Obstacles  to  a  high  of  35 
hours  for  General  Weather  Conditions. 

Importance  and  perishability  ratings  were  logarithmically  transformed 
prior  to  analysis.  This  class  of  transformations  has  been  traditional ly 
applied  to  direct-estimation  data,  such  as  the, present  ratings  (Stevens, 

1975).  Repeated  Measures  Analysis  of  Variance  analyses  indicated  that 
importance  ratings  varied  across  information  elements  (F  (20,40)  =  181.53, 
£<.001 )  and  the  rated  importance  of  information  elements  also  varied  across 
operations  (F  (40,40)  =  9.12,  £<.001).  Analyses  also  revealed  significant 
variation  of  perishability  ratings  across  information  elements  (F  (37,74) 
=40.03,  £<.0001)  and  the  rated  perishability  of  information  element 
categories  was  found  to  vary  across  operations  (F  (4,74)  =  4.05,  £<.005). 

Both  rated  importance  and  rated  perishability  of  information  elements 
were  found  to  be  significantly  correlated  with  observed  frequency.  For  rated 
importance,  r  (119)  =  .58,  £  <  .001;  and  for  rated  perishability,  r  (119)  =  - 
.42,  £  <  .001.  It  should  be  noted  that  the  positive  correlations  Between 
information  element  rated  importance  and  observed  frequency,  and  the  negative 
correlations  between  frequency  and  perishability  were  anticipated  from  control 
theory  considerations. 

Non-linear  regression  was  used  to  predict  the  observed  frequency  of 
communications  using  the  averaged  importance  and  perishability  ratings  for 
each  tactical  operation.  The  resulting  fitted  relationships  were  of  the 
general  form  presented  in  Equation  1. 


Ln(Freq+l)  »  Cq  +  2.89*Ln(Import+l)  -,679*Ln(Perish+l)  (EQ.l) 


Referring  to  Equation  1,  Ln  indicates  a  natural  logarithmic  transformation; 
Freq  is  information  element  observed  frequency,  Import  and  Perish  are  the 
mean  ratings,  and  Cq  was  a  fitted  constant  which  varied  with  operations. 
Multivariate  correlation  analysis  supported  the  significance  of  this 
combination  of  the  rating  variables.  Predicted  frequency,  using  the 
combination  of  rating  variables  shown  in  Equation  I  was  found  to  be 
significantly  correlated  with  observed  frequency  (R  (5,  117)  =  0.68,  p  < 
.0001). 

A  procedure  for  computing  a  comprehensive  index  of  information  element 
criticality  was  developed,  based  upon  the  analyses  described  above  and  a 
consideration  of  the  nature  of  the  separate  measures  used  ir  this  study.  The 
basic  premise  in  developing  this  comprehensive  index  was  that  the  "expected" 
frequency  of  observed  communications  within  the  TOC  provided  the  primary 
measure  of  criticality.  Importance  and  perishability  ratings,  in  light  of 
this,  were  judged  to  provide  an  additional  contribution  to  the  specification 
of  a  comprehensive  criticality  index  in  three  related  ways.  First,  ratings  of 


4 


importance  and  perishability  provide  a  broader  basis  upon  whicli  to  base  an 
index  of  criticality.  Second,  the  ratings  are  based  on  brigade  principals' 
more  general  consideration  of  tactical  circumstances,  resulting  in  increased 
generality  of  the  findings.  Finally,  for  infrequently  communicated 
information  elements,  importance  and  perishaL  lity  ratings  provide  a  means  of 
better  differentiating  between  information  elements.  Based  on  these 
considerations,  it  was  determined  that  observed  commun ication  frequency  and 
the  combination  of  rating  scores  for  each  information  element  would  be 
weighted  equally  in  computing  a  comprehensive  index  of  criticality. 
Additionally,  the  separate  weights  for  the  rating  measures  would  be  based  upon 
Equation  1.  The  resulting  calculation  of  comprehensive  criticality  across 
tactical  operations  is  the  geometric  mean  cf  observed  and  predicted 
information  element  frequency: 


Ln(Criticality)  *  ln(Freq*^l)  +  Ln{Freq  +  1)  (EQ.  2) 
wiiere  ln(Freq  +1)  and  Ln(Freq  +1)  are  as  defined  earlier  (EQ.  1). 


Discussion 

The  present  approach  towards  the  determination  of  user  information 
requirements  has  two  major  advantages  over  the  more  commonly  employed 
approach  of  expert  panel  evaluation.  First,  it  is  based  on  operationalized 
measures  which  are  amenable  to  replication.  Second,  the  measures  upon  which 
it  is  based  were  obtained  within  the  context  of  tactical  operations, 
enhancing  their  validity. 

The  resulting  criticality  measures  are  intended  to  be  used  by  system 
designers  responsible  for  determining  the  content  and  format  of  information 
to  be  conveyed  and  processed  by  the  FLCS.  By  combining  the  separate  measures 
into  a  single  index  of  information  element  criticality,  the  current  method  is 
intended  to  provide  a  means  of  conducting  tradeoff  analysis  of  alternative 
system  information  loads. 

The  general  approach  of  calculating  a  composite  information  element 
criticality  index  has  recently  been  replicated  in  a  second  study  of  brigade 
command  and  control  information  ■ equirements.  In  that  study,  comparable 
correlations  between  informatior>  element  frequency  and  rated  importance  and 
perishabi 1 ity  were  obtained.  Additionally,  the  composite  calculation  (EQ.  2) 
had  comparable  weights.  However,  the  criticality  of  specific  information 
elements  varied  from  that  reported  fiere.  This  latter  finding,  in  conjunction 
with  the  obtained  interactions  of  information  clement  frequency  across 
tactical  operations,  points  tc  the  need  to  obtain  a  representative  sample  of 
data  prior  to  final  specification  of  information  requirements. 

F  ^ther  examination  of  the  individual  information  elements  also  points  to 
a  fundamental  difference  in  the  type  of  information  element  flowing  within  the 
command  and  control  system.  On  the  one  hand,  there  is  a  class  of  information 
elemenfs  that  constitutes  inputs  to  the  commander’s  decision  process.  These 
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arc  represented  by  elements  such  as  enemy  unit  location  and  status,  maneuver 
unit  status,  and  arri  inition  status.  On  the  other  hand,  there  is  a  class  jf 
information  elements  that  constitutes  out{)uts  of  the  decision  process. 

Fxamples  of  outputs  are  brigade  mission  and  Brigade  concept  of  operations. 

Our  observation  of  commander  and  staff  functioning  during  Llie  exercise 
led  us  10  conclude  that  the  commander's  decision  making  process  is  a  cyclical 
process,  which  is  reiterated  as  new  informatrin  becomes  available  and 
uncertainties  are  resolved.  Thus,  outputs  of  the  decision  process  are  fed 
back  through  the  process  and  plans  are  modified  and  refined,  as  illustrated  in 
Figure  2.  Future  research  will  examirie  the  empirical  'relationship  between 
criticality,  perishability,  and  frequency  of  information  elements  as  a 
fiinction^^thoir  role  as  decision  process  inputs  versus  outputs. 
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